(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
7 November 2002 (07.11.2002) 




PCT 



lliillllliliilillilllliliilll^ 

(10) International Publication Number 

WO 02/088853 Al 



(51) lateniatiooal Patent Classification^: G05B 19/18, 
15/00, G09G 5/00, 5/08 

(21) International Application Number: PCT/US02/13181 

(22) International Filing Date: 25 April 2002 (25.04.2002) 

(25) Filing Language: English 

(26) Publication Language: English 



(30) Priority Data: 
60/286,860 



26 April 2001 (26.04.2001) US 



(71) Applicant: CAVEO TECHNOLOGY, LLC [USAJS]; 
411 Massachusetts Avenue, Cambridge, MA 02139-4102 
(US). 

(72) Inventors: VERPLAETSE, Christopher; 35 Skehan 
Street, Someville. MA 02143-3737 (US). LEE, David, 
W,; 343 Otis Street. West Newton, MA 02465-2533 (US). 
EVANS* Thomas, P.; 23 Palmer Street, Watertown, MA 
02472-2757 (US). LANEMAN, Jerry, Nicholas; 1 Vassal 
Street, Quincy, MA 02170 (US). 



(74) Ageats: COLEMAN, Roy, J. et al.; landiono & Teslca, 
260 Bear Hill Road. Waltham. MA 02451-1018 (US). 

(81) Designated States (national): AE. AG, AL, AM, AT. AU, 
AZ, BA, BB, BG. BR. BY, BZ, OA, CH, CN, CO, CR, CU, 
CZ, DE, DK, DM, DZ, EC, EE, ES, H, GB, GD, GE, GH, 
GM, HR. HU, ID, IL, IN, IS. JP, KB. KG, KP, KR, KZ. LC, 
LK. LR, LS, LT. LU. LV, MA, MD. MG. MK, MN, MW, 
MX. MZ, NO. NZ, OM. PH, PL. PT. RO. RU. SD. SE. SG, 
SI, SK, SL, TJ, TM, TN, TR, IT. TZ, UA. UG. UZ. VN. 
YU. ZA, ZM, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW. MZ, SD. SL. SZ, TZ, UG, ZM. ZW). 
Eurasian patent (AM, AZ, BY, KG, KZ. MD. RU. TJ, TM). 
European patent (AT. BE, CH. CY, DE. DK, ES. FI, FR. 
GB. GR, IE. IT. LU, MC, NL, PT, SE, TR), OAPI patent 
(BF. BJ. CF. CG. CI, CM, GA. GN, GQ. GW. ML. MR. 
NE. SN. TD. TG). 

Published: 

— with international search report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations'* cg^pearing at the begin- 
ning of each regular issue of the PCT Gazette. 



00 
00 
00 

(57) Abstract: A motion -based input system including a motion sensor coupled to a device. The motion sensor provides a motion 
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MOTION-BASED INPUT SYSTEM FOR HANDHELD DEVICES 



FTFJ.n OF THE INVENTION 
This invention relates to a motion-based input system and more particularly, to a 
motion*based input system for use with electronic devices. 

RELATED APPLICATIONS 
This appUcation claims priority of United States Utility Application No, 
09/572,801 filed May 17, 2000; 09/773,165 filed January 31, 2001; and Provisional . 
Application No. 60/286,860 filed April 26, 2001 . All of these applications are 
incorporated by reference herein. 

BACKGROUND OF THE INVENTION 
Modem electronic devices are become increasingly smaller in size. There are now 
personal data assistants (PDAs), handheld personal computers, cellular telephones, 
televisions, pagers, and computerized Rolodexes which fit in the palm of the hand. 
Typical prior art devices employ a mouse to position a pointer over an icon, and a "double 
click" is required to select the desired program associated with the icon. Other prior art 
devices use a combination of stylus and/or an "enter" key or button to select a desired 
program or to perform other actions. Other prior art devices employ a combination of 
position commands (e.g., tilting) to move the cursor and an "enter" key to select and 
activate the desired program. However, as these devices get increasingly smaller and the 
screensize requirements get relatively larger, traditional input buttons, enter keys, keypads 
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and pointing devices are becoming more and more difficult for users to use and for 
manufacturers to incorporate into the devices. 

One attempt to eliminate the need for keys, keypads and pointing devices is found 
in U.S. Patent No. 6,347,290, herein incorporated in its entirety by this reference. This 
proposed motion-based input system, however, actually compUcates the control and 
operation of the device by requiring a combination of different position commands (e.g., a 
particular orientation of the hand) and gesture conunands (e.g., a time varying position 
expressed as a unique pattern of movement over an interval of time) to control and 
operate the device. Further, the apparatus and method as disclosed in the '290 patent 
requires the cumbersome task of inputting the various gesture conunands into the system, 
storing the conunands in a database, and memorizing them. Moreover, the gesture 
conunands are typically complex patterns of movement which require physical dexterity 
of the hand. 

Such a device is cumbersome and complicated because it requires both a position 
command and a gesture command to control and operate the device and requires the user 
to memorize each of the various gesture motions associated with the commands stored in 
the database. Moreover, because the gesture commands require dexterity of the hand, 
operation of this device is difBcult and/or impossible for handicapped persons with 
limited hand motion. 

In addition, application of the device and method disclosed in the *290 patent to 
mice technology would require lifting and tilting of the mouse to position the pointer (i.e. 
"point") over the desired icon, then performing a gesture command to activate the 
program associated with the icon (i.e. "click"). Clearly, this is an inefficient and 
cumbersome way to operate a mouse. 
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Other motion detection systems, ^uch as those disclosed in U.S. Patent Nos. 



5,477,236 and 5,910,797, also incorporated herein in their entirety by this reference, 
suffer from the same or similar problems. 



It is therefore an object of this invention to provide an improved motion-based 
input system. 

It is a further object of this invention to provide such a motion-based input system 
which can be made to perform a combination of one or more actions or commands to 
control and operate a device by simply moving and tapping the device. 

It is a fiirther object of this invention to provide such a motion-based input system 
which eliminates the need for complicated gesture conunands. 

It is a further object of this invention to provide such a motion-based input system 
which is simple and easy to operate. 

It is a further object of this invention to provide such a motion-based input system 
which can be used by persons with limited hand dexterity. 

It is a further object of this invention to provide such a motion-based input system 



handheld devices. 

This invention results from the realization that a truly innovative motion-based 
input system which is simple and easy to operate requires only a tap on a device for one 
type of action (e.g., "enter") and motion of the device for a different action (e.g., cursor 
movement) or a combination of motions and taps in order to completely control and 
operate the device. 



SUMMARY OF THE INVENTION 




l,fnr-hiittnnsJbiLperfQrrning select and execut e actions on 
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This invention features a motion-based input system comprising a motion sensor 
coupled to a device, the motion sensor providing a motion signal corresponding to the 
movement of the device, and a processor responsive to the motion signal and configured 
to distinguish between a t^ conunand and a position command and to provide, in 
response to a tap conmiand, one or more actions, and in response to a position command, 
one or more different actions to control and operate the device. 

In one embodiment of this invention, the processor detects a tap command by 
computing the power spectral density of the motion signal and comparing the energy level 
of the computed power spectral density of the motion signal with a predetermined threshold 
energy level for a predetermined threshold frequency range. Ideally, the predetermined 
threshold levels are configurable to adjust the sensitivity of the tap detected by the 
processor. In one prefeired embodiment, the predetermined threshold frequency detected 
by the processor is greater than or equal to 5 Hz. In one example, the predetermined 
threshold levels are stored in a memory. Preferably, the processor of the motion-based 
input system of this invention is a microprocessor. 

In one design, the motion-based input system of this invention may further include 
an interface between the processor an operating system resident on the device. In a 
preferred embodiment, the motion-based input system further includes controlling 
software to control and operate the device based on the processor actions. Ideally, the 
motion sensor of the motion-based input system of this invention is an accelerometer and 
is coupled to an electronic device. 

In one preferred design of this invention, the controlling software is programmed to 
display a graphical representation which indicates the direction of a current or a proposed 
position command. In one example, a continuous input mode provides continuous cursor or 
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pointer movement in the direction of the current position conmiand. Typically, the rate of 
cursor or pointer movement provided by the continuous input mode is proportional to the 
magnitude of the position command. Preferably, the controlling software may be 
programmed to display a gr^hical representation to indicate the direction of the continuous 
cursor or pointer movement. 

In one preferred embodiment if this invention, a stepped input mode indicates the 
direction of a proposed position command and moves the cursor or pointer in the direction 
of the proposed position command in response to a t^ command. Ideally, the controlling 
software is programmed to display a graphical representation to indicate the direction of the 
proposed position command. 

In one design, the processor of the motion-based input system of this invention is 
configured to select a continuous input mode or a stepped input mode depending on the 
active software application. 

This invention also features a motion-based input system comprising a motion 
sensor coupled to a device, the motion sensor providing a motion signal corresponding to 
the movement of the device, and a processor, responsive to the motion signal and 
configured to detect a tap command, and provide, in response to the tap command, one or 

— more actions to op erate- and control th e -device. 

In one example, the processor is responsive to the motion signal and may be 
configured to detect an impulse command, and provide, in response to the impulse 
command, one or more actions to control and operate the device. In other designs of this 
invention, the processor responsive to the motion signal may be configured to distinguish 
between a tap command and a tilt conmiand and to provide, in response to the tap 
command one or more actions and in response to the tilt command, one or more different 
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actions to control and operate the device. 

This invention further features a motion-based input system comprising a motion . 
sensor coupled to a device, the motion sensor providing a series of motion signals 
corresponding to movements of the device, and a processor, responsive to the series of 
motion signals, configured to detect a series of tap commands, and to provide, in response 
to the series of tap commands, one or more actions to operate and control the device. 

In one example, the processor responsive to the motion signals may be configured 
to distinguish between a series of tap commands and a series of position commands on the 
device, and to provide in response to the series of tap commands, one or more actions, 
and in response to the series of position commands, one or more different actions to 
operate and control the device. 

This invention further features a motion-based input system comprising motion 
sensing means coupled to a device for sensing motion and providing a motion signal 
corresponding to the movement of the device, and processing means responsive to the 
motion signal and configured to distinguish between tap commands and position 
commands and to provide, in response to the tap commands one or more actions and in 
response to the position commands one or more different actions to control and operate 
the device. 

This invention also features a method for processing input commands for a device. 
The method includes detecting a motion signal corresponding to movement of the device, 
analyzing the motion signal to distinguish between a tap command and a position 
command, and providing, in response to a tap command, one or more actions and 
providing in response to a position command, one or more different action, to control and 
operate the device. 
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In one design, the motion-based input system of this invention typically includes a 
motion sensor coupled to a device, the motion sensor providing a motion signal 
corresponding to the movement of the device, and a first action or series of actions 
associated with a tap on the device, a second action or series of actions associated with 
other movement of the device, a processor responsive to the motion signal and configured 
to distinguish between a tap on the device and other movement of the device; and to 
provide, in response to a tap, said first action or series of actions and in response to the 
other movement, said second action or series of actions to control and operate the device. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Other objects, features and advantages will occxir to those skilled in the art from 
the following description of a preferred embodiment and the accompanying drawings, in 
which: 

i Figs. 1 A- IF are schematic three-dimensional views of a typical prior art motion 

based input system employed in a PDA; 

Figs. 2A-2D are schematic three-dimensional views showing one example of the 
motion based input system of the subject invention also employed in a PDA; 

Fig s. 3 A - 3E ^c schemati c th ree dimcnsion al^viewso^ano ther ex am ple o ilthe 

motion based input system of this invention employed in a cellular telephone. 

Fig. 4 is a partially broken away schematic view showing the primary components 
associated with the motion based input system of this invention when employed in a 
PDA; 

Figs. 5 A and 5B are schenlatic three-dimensional views of another example of the 
motion based input system in accordance with this invention employed in PDA; 
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Fig. 6 is a partially broken away schematic view showing the primary components 
associated with the motion based input system of the subject invention when employed in 
a computer mouse; 

Fig. 7 is graph showing a waveform representing a tilt of a device, gesture motion 
of the device, and a tap on the device; 

Figs. 8A-8C are graphs showing in greater detail the wavefomis for the motion 
events shown in Fig. 7; 

Fig. 9A-9C are graphs showing frequency content in terms of spectral density for 
each motion event shown in Figs. 8A-8C; and 

Fig. 10 is a flow chart of one embodiment of the motion-based method for 
processing commands for an electronic device in accordance with the present invention. 

DISCLOSURE OF THE PREFERRED EMBODIMENT 
Aside from the preferred embodiment or embodiments disclosed below, this 
invention is capable of other embodiments and of being practiced or being carried out in 
various ways. Thus, it is to be understood that the invention is not limited in its 
application to the details of construction and the arrangements of components set forth in 
the following description or illustrated in the drawings. 

As explained in the Background section above, prior art motion-based input 
system 10, Fig. 1 as employed in handheld electronic device 12 such as a PDA, requires a 
combination of position commands (which relate to a particular angular orientation of 
electronic device 12) and gesture conmiands (time varying positions expressed as a 
unique pattern of movement in an interval of time) to control and operate electronic 
device 12. See U.S. Patent No. 6,347,290. As shown in Fig. 1 A, icon 18 on screen 16 of 



BNSOOCID: <WO_02088853A1J_> 



BNS page 9 



wo 02/088853 



PCT/US02/13181 



9 

electronic device 12 is not highlighted or selected, hi order to select the desired program 
associated with icon 18a user typically performs a position command by tilting electronic 
device 12, as shown in Fig. IB to highlight or focus on icon 18. After returning electronic 
device 12 to its original position as shown in Fig. IC, prior art motion-based input system 
10 requires a gesture command to invoke the "enter" command and to select the desired 
program associated with icon 18. This gesture command is a time varying position 
expressed by a unique memorized pattern of movement, such as the somewhat 
cumbersome pattern between Figs. ID and IE over a specific interval of time to activate 
the selected program associated with icon 1 8, such as calendar program 20, Fig. IF. 
Moreover, prior art motion-based input system 10 requires a user to first input all the 
user's gesture commands into the system, store the various gesture conunands associated 
with the unique patterns of movements in a database, and then memorize the patterns of 
movements associated with the user's selected gesture commands. 

Thus, system 10 suffers Scorn several distinct disadvantages. First, the device is 
cumbersome and complicated to operate because it requires both position commands to 
perform selections and gesture conunands to enter or activate the selection. Second, 
system 10 requires the user to input and memorize the patterns of movements associated 
— with cho sen-ge sture commands stored in a-database> Third, as - shown in t he e x a mple — : — 
above, prior art motion-based input system 10 employs gesture commands which require 
hand dexterity, and therefore system 10 is not useful by handicapped persons with limited 
hand dexterity. 

In sharp contrast, motion-based input system 50, Fig. 2 of the subject invention is 
much easier to use. System SO includes a motion sensor (not shown in Fig. 2) coupled to 
(e.g., directly within, on, or indirectly attached to) device 54, such as a PDA, a hand held 
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computer, or any other small handheld electronic or other device. The motion sensor 
provides a motion signal corresponding to movement of device 54. A processor (also not 
shown in Fig. 2) is responsive to the motion signal and is configured to distinguish 
between a tap on device 54 and other motion of device 54 and to provide, in response to a 
tap, one or more actions or commands (for example an "enter'* command), and, in 
response to other motions (e.g., tilts, rotational motions, and/or translational motions), one 
or more different action or commands (e.g., cursor movement) to fully control and easily 
operate device 54. Thus, there are tap commands and motion commands. Because 
motion-based input system 50 is designed and configured to respond to tap commands as 
well as motion commands, a user, in one example, need only tilt device 54 to select a 
desired action or position command, then simply tap the device 54 to "enter" or activate 
the selected action. The result is a motion-based input system which is simple and easy to 
operate, which eliminates the need to memorize patterns of movement (e.g., gesture 
commands) to select conmiands stored in a database, and a unique system can be more 
easily used by persons with limited hand dexterity. 

For example, in one embodiment of this invention as shown in Figs. 2 A-2D, a user 
can highlight or focus on icon 60 located on screen 59 of device 54 to select the particular 
application associated with icon 60 (such as a calendar program, or any other of the vast 
array of software programs available on hand held electronic devices) by tilting device 54 
down to the right as shown in Fig. 2B. The motion sensor detects this motion of device 
54 and provides a motion signal to the processor which responds by providing the 
appropriate commands to focus or highlight icon 60, as shown by icon 60 now being 
highlighted. Once icon 60 is focused or highlighted, the user simply taps electronic 
device 54, as shown at 55, Fig 2C. The uniquely configured processor, responsive to the 
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motion signal output by the sensor, detects the tap command and provides the appropriate 
actions to activate, in this example, calendar program 62, Fig. 2D, that is, an "enter" 
command is invoked, but without an enter button, mouse cUck, or gesture command. 

Because the robust design of the motion-based input system of this invention 
detects a tap on device 54 and in response to the tap provides one or more actions to 
control and operate a device 54, a vast array of actions based on a simple tap or a series of 
taps can be invoked on a wide variety of electronic and even other devices. 

For example, in another embodiment of the subject invention, motion-based input 
system 50', Fig. 3A also includes a motion sensor coupled to electronic device 70, here a 
cellular telephone. The motion sensor provides a motion signal corresponding to 
movement of electronic device 70 and the processor detects a tap command as shown at , 
71 , Fig. 3B and provides, in response to the tap command, action 72 which causes the 
cellular phone to dial the user's workplace. In another example, the processor detects a 
different tap command, for example a tap with more intensity, as shown at 73 in Fig. 3C 
and provides, in response to the tap command, action 74, which invokes the wireless 
phone to check a user's voice mail. Alternatively, the processor of motion-based input 
system 50' may be configured to detect a series of tap commands, shown at 75 in Fig. 3D 

-and-at"77-4n-Figr6E— and-r^pond-t o th e s eries- of tap comm ands^^ovidingr4n-this 

example, action 76 which causes the cellular telephone to dial and check a user's e-mail. 

The result is a motion-based input system which provides the ability to perform a 
wide range of actions or commands based on a simple tap or series of taps on the device 
without the need for buttons, a mouse, a keyboard, and without the need to perform 
gesture commands, to store the gesture conunands in a database, or to njemorize the 
gesture commands. Moreover, any device which employs the motion based input system 
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of this invention can be easily used by persons having limited hand dexterity. 

As shown in detail in Fig. 4, motion-based input system SO of this invention 
typically includes motion sensor 80 coupled to device S4. Ideally, motion sensor 80 is an 
accelerometer, such as multi-axis MEMS accelerometer (for example part no. ADXL 202 
available from Analog Devices, Inc., Wilmington, MA). Motion sensor 80 provides a 
motion signal corresponding to movement of device 54. As stated supra^ processor 82 is 
uniquely configured to distinguish between tap commands (e.g., "enter") on device 54 and 
position commands (e.g., tilting) of device 54 and provides, in response to a tap 
command, one or more actions, and provides in response to position commands, one or 
more different actions to control and operate device 54. 

In one design of this invention, motion-based input system 50 may include 
interface 84 which provides the interconnection between processor 82 and operating 
system 86 of the particular device 54. Typically, motion-based input system 50 includes 
controlling software 88 which controls and operates device 54 in response to commands 
issued by processor 82. Processor 82 may be a separate processor or a processor already 
associated with the electronic device. 

In one preferred embodiment of this invention, controlling software 88 is 
programmed to display a small compass like icon on the screen with graphical elements 
such as arrows, to indicate the direction of the current position command (e.g., tilting). 
Tilt based position commands are performed by rotating device 54 to cause an angular 
deflection with respect to a reference orientation "neutral". When a tilt of a sufficient 
magnitude occurs the compass will show a graphical arrow in the direction of that tilt and 
will move the cursor, pointer, or equivalent software entity in the same direction. The 
rate of cursor motion may optionally be proportional to the angle of deflection. This 
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example is typically referred to as a "continuous" input mode. If a tap command occurs 
while the device is tilted, the neutral reference orientation will be redefined to be the 
current orientation. If a tap command occurs while device 54 is in its neutral orientation, 
a select, enter, or equivalent software action will be performed. 

In another example of this invention, called "stepped" input mode, the compass 
like icon on the screen will display the same graphical elements, such as arrows and the 
like, to indicate the direction of the proposed position command. In this example, a tilt 
motion of sufficient magnitude will cause the compass to show a graphical arrow in the 
direction of that tilt, but software 88 will not move the cursor or pointer until a tap 
command is performed while device 54 is tilted. If a tap command occurs while device 
54 is tilted, software 88 moves the cursor. If a tap command occurs while device 54 is in 
neutral, software 88 performs a select or enter action. Optionally, a new neutral reference 
orientation may be set by tilting device 54 to the desired neutral orientation and not 
tapping it for a predetermined length of time. In one design of this invention, processor 82 
is configured to select a continuous input mode or a stepped input mode depending on the 
active software application on device 54. Alternatively, in another design, as discussed 
below, software 88 may be programmed select a continuous input mode or a stepped input 

modedepending-on-tiie-active-software-appKcation-^^ 

As an illustrative example of stepped input mode in accordance with this 
invention, if active program 200, Fig. 5 A is an electronic spreadsheet and a user desires to 
move the active cell 202 from location B3 one cell to the left (cell A3), the position 
command of tilting device 54 to the left, as shown in Fig. 5B, causes controlling software 
88 to display compass 204 on screen 206. Arrow 208 of compass 204 indicates the 
direction of the proposed movement of the active cell. A tap command as shown at 212 is 
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detected by the motion sensor, and as discussed supra, processor 82 detects the tap 
command and provides, in response to the tap command, the action of moving the active 
cell to the left one cell, or to cell 210 at location A3. Similarly, though not shown, 
position conmiands, such as tilting electronic device to the right, down, or up will cause 
controlling software 88 to display compass 204 with arrow 208 pointing in the direction 
of the proposed movement which will be completed after the tap command is performed. 

In another embodiment of this invention, controlling software 88 is programmed 
to detect the current application or program being used on device 54. Controlling 
software 88 is ftuther uniquely programmed to determine the best motion-based input 
method for the application active on device 54. For example, if a flight simulator game is 
active on device 54, the best motion-based input system is the continuous mode. In this 
example, position commands (e.g., tilting) of the device provide the actions associated 
with controlling the simulated airplane and tap commands fire weapons. In another 
example, such as an electronic phone book, the stepped input mode, which uses a 
combination of tap commands and position conunands, is the best motion-based input 
method to issue the appropriate actions of scrolling through the phone book. 

In another example, motion-based input system 50", Fig. 6 of this invention is 
employed in buttonless computer mouse 90, where a tap on mouse 90 serves as the 
"click" button and movement of the mouse (i.e., position commands) serve as the "point". 
Motion sensor 80 provides a motion signal corresponding to movement of mouse 90 and 
processor 82 is responsive to the motion signal and configured to distinguish between a 
tap command on mouse 90 and a position conunand (e.g., movement) of mouse 90 and to 
provide, in response to a tap command, a click action and, in response to the position 
command, point actions to operate computer 100. 



BNSOOCID: <WO__02088853AtJ_> 



BNS page 15 



wo 02/088853 PCTAJS02/13181 

15 

Motion-based input system 50" typically includes interface 84\ such as a serial 
link, which is remotely located from motion sensor 80 and processor 82, and provides an 
interconnection between processor 82 and operating system 86* of computer 100. 
Although, in this example interface 84' is remotely located from mouse 90, in other 
examples interface 84' may be coupled within mouse 90. The result is a completely 
buttonless mouse which can be operated by simple tap commands and position commands 
of mouse 90, hence eliminating the need for any buttons which significantly extends the 
lifetime of mouse 90 and provides for simple operation of the mouse. 

As shown in Fig. 7, graph 250 depicts three signals corresponding to motion input 
events or commands, e.g., a tilt, a gesture and a tap, which can be detected by a typical 
motion sensor. A tilt, as shown by section 252, is characterized as a change from one . 
angular orientation to another. This type of motion or command produces a gradual shift 
of DC offset and generally has a low frequency content. A gesture motion command, as 
shown by section 254, is characterized as a dynamic and continuous changing signal over 
a period of time having a low to medium frequency content. A tap conunand, as shown 
by section 256, is an impulse type signal produced over a short period of time and has a 
high frequency content. Tap conunands are also known as impulse commands because of 
"the impulse nature of the motion^caused by"a~tap-command. Detailed views of the tilt, 
gesture and tap signals shown in Fig. 7 is shown in Figs. 8 A, 8B, and 8C, respectively. 

Ideally, in this invention, processor 80 detects a tap or impulse command, as 
shown at 256, Figs. 7 and 8C by computing the power spectral density (PSD) of the 
motion signal and comparing the power level for a predetermined frequency range with a 
predetermined power level threshold. The PSD describes how the power (or variance) of 
a time series is distributed with frequency. It is defined, in mathematical temis, as the 
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Fourier Transform of the autocorrelation sequence of the time series and it has units of 
power per unit of frequency. The computed PSD of the tap conunand signal shown by 
graph 256, Fig. 8C is shown as waveform 258, Fig. 9C. Similarly, the computed PSD of 
the tilt command signal shown by graph 252, Fig. 8A is shown by waveform 260, Fig. 9A. 
The computed PSD of gesture command signal shown by graph 254, Fig. 8B is shown by 
waveform 262, Fig. 9B. 

As can be seen by the computed PSD shown by wavefomi 258, Fig. 9C, a tap 
command has a significantly higher energy level and frequency content than the computed 
PSD for tilt conmiand, as shown by waveform 260, Fig. 9A, and the computed PSD for a 
gesture command, as shown by waveform 262, Fig. 9B. Processor 80 of motion-based 
input s>^tem 50 of this invention is uniquely configured to detect the higher energy level 
and frequency from the computed PSD of a tap command as discussed above. 

In one preferred embodiment, processor 80 is configured to detect predetermined 
threshold frequency greater than or equal to 5 Hz. In one example, the predetermined 
threshold levels are stored in a memory within processor 80, although the predetermined 
threshold levels may also be stored in an external memory. Ideally, the threshold levels 
detected by processor 80 are configurable to adjust the sensitivity of the tap detected by 
processor 56. This unique feature renders motion-based input system 50 able to 
distinguish between an inadvertent tap command on device 54 which is not intended to 
invoke any commands, and a tap which is intended to issue commands. Ideally, processor 
82 also detects a tilt command (e.g., angular deflection) of device 54. In a preferred 
embodiment, processor 82 is a microprocessor which is progranuned to distinguish 
between a tap command on device 54 and a position command of device 54, 

In accordance with the method of this invention, input commands are processed 
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for a device, which includes the steps of detecting a motion signal corresponding to 
movement of the device, step 300, Fig. 10; analyzing the motion signal to distinguish 
between a tap command and a position conmiand, step 302; and providing, in response to 
the tap command, one or more actions and providing, in response to a position conunand, 
one or more different actions, step 304, to control and operate the device. Typically, a tap 
is associated with an action such as '^enter" but different series of taps may be associated 
with, in a memory, for example, with a number of different actions as explained above 
with reference to Fig. 3. Also, different motions are associated, also perhaps in a 
memory, with different position commands. For example a tilt to the right means move 
the cursor to the right and the like. See also co-pending application Serial No. 09/773,165 
filed January 3 1 , 2001 incorporated herein by this reference. 

The robust motion-based input system of this invention is uniquely designed to 
detect tap commands and further designed to distinguish between tap commands on an 
electronic device and position commands of the electronic device. The robust design not 
only distinguishes between tap commands and position commands, but also provides one 
or more actions in response to the tap commands, and one or more different actions in 
response to the position commands. This unique feature provides the ability to perform a 

vastxombTnatron'of^actionsi>ased-on-arsimpieiap7or-a-combinB 

position commands. The ability to detect a tap and perform one or more actions 
eliminates the need to perform the complex gesture commands of the prior art, which are 
often difficult and/or impossible to perform by persons of limited hand dexterity. The 
system of this invention is simple and easy to operate and can even be applied to mouse- 
technology JtQ provide for a completely buttonless mouse which does not need to be lifted 
or require elaborate motions to invoke certain commands. Moreover, there is no need to 
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configure the system by perfonning elaborate gesture conunands which must be stored in 
a database, or memorizing the patterns of movement associated with the gesture 
conmiands. Moreover, enter keys and buttons can be eliminated in any electronic device. 

Although specific features of the invention are shown in some drawings and not in 
others, this is for convenience only as each feature may be combined with any or all of the 
other features in accordance with the invention. The words "including", "comprising", 
"having", and '*with" as used herein are to be interpreted broadly and comprehensively 
and are not limited to any physical interconnection. Moreover, any embodiments 
disclosed in the subject application are not to be taken as the only possible embodiments. 

Other embodiments will occur to those skilled in the art and are within the 
following claims: 

What is claimed is: 
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CLAIMS 

1 . A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
motion signal corresponding to the movement of the device; and 

a processor responsive to the motion signal and configured to: 
distinguish between a tap conmiand and a position 
command and to provide, in response to a tap conmiand, 
one or more actions, and in response to a position 
command, one or more different actions to control and 
operate the device. 

2. The motion-based input system of claim 1 wherein the processor detects a 
tap command by computing the power spectral density of the motion signal and comparing 
the energy level of the computed power spectral density of the motion signal with a 
predetermined threshold energy level for a predetermined threshold frequency range. 

3. The motion-based input system of claim 2 in which the predetermined 
r^ faold level s-ar^-eonfiguf abte4o-adjust4he-S€nsitivi^^-oi^ 

processor. 

4. The motion-based input system of claim 3 in which the predetermined 
threshold frequency detected by the processor is greater than or equal to 5 Hz. 

5. The motion-based input system of claim 2 in which the predetermined 
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threshold levels are stored in a memory. 

6. The motion-based input system of claim 1 in which the processor is a 
microprocessor. 

7. The motion-based input system of claim 1 further including an interface 
between the processor an operating system resident on the device. 

8. The motion-based input system of claim 7 further including controlling 
software to control and operate the device based on the processor actions. 

9. The motion-based input system of claim 1 in which the motion sensor is an 
accelerometer. 

10. The motion-based input system of claim 1 in which the device is an 
electronic device. 

1 1 . The motion-based input system of claim 8 in which the controlling 
software is programmed to display a graphical representation which indicates the 
direction of a current or a proposed position command. 

12. The motion-based input system of claim 1 1 in which a continuous input 
mode provides continuous cursor or pointer movement in the direction of the current 
position command. 



BNSDOCIO: <WO_020S8853A1_L> 



BNS page 21 



wo 02/088853 PCTAJS02/13181 

21 



13. The motion-based input system of claim 12 in which the rate of cursor or 
pointer movement provided by the continuous input mode is proportional to the 
magnitude of the position command. 

14. The motion-based input system of claim 1 3 in which the controlling 
software is progranmfied to display a graphical representation to indicate the direction of 
the continuous cursor or pointer movement. 

15. The motion-based input system of claim 1 1 in which a stepped input mode 
indicates the direction of a proposed position command and moves the cursor or pointer in 
the direction of the proposed position conunand in response to a tap command. 

1 6. The motion-based input system of claim 1 5 in which the controlling 
software is programmed to display a graphical representation to indicate the direction of 
the proposed position conunand. 

17: TfreTnotion=basedinputsystem-of-clain[H4-ii^ 

configured to select a continuous input mode or a stepped input mode depending on an 
active software application. 

18. A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
motion signal corresponding to the movement of the device; and 
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a processor, responsive to the motion signal and configured to: 
detect a tap command; and 

provide, in response to the tap command, one or more 
actions to operate and control the device. 

19. The motion-based input system of claim 18 wherein the processor detects a 
tap command by computing the power spectral density of the motion signal and comparing 
the energy level of the computed power spectral density of the motion signal with a 
predetermined threshold energy level for a predetermined threshold frequency range. 

20. The motion-based input system of claim 19 in which predetermined 
threshold frequency detected by the processor is greater than or equal to 5Hz. 

21 . A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
motion signal corresponding to the movement of the device; and 

a processor responsive to the motion signal and configured to: 

detect an impulse command, and provide, in response to the 
impulse command, one or more actions to control and 
operate the device 

22. A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
motion signal corresponding to the movement of the device; and 
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a processor, responsive to the motion signal and configured to: 

distinguish between a tap command and a tilt command and 
to provide, in response to the tap command one or more 
actions and in response to the tilt command, one or more 
different actions to control and operate the device. 

23. A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
series of motion signals corresponding to movements of the device; and 

a processor, responsive to the series of motion signals, configured 

to: 

detect a series of tap commands; and 

to provide, in response to the series of tap commands, one 

or more actions to operate and control the device. 

24. A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
series ot motion signals corresponding lo movements of^he dcvice; and 



a processor, responsive to the motion signals and configured to: 
distinguish between a series of tap commands and a series 
of position commands on the device, and to provide in 
response to the series of tap commands, one or more 
actions, and in response to the series of position commands, 
one or more different actions to operate and control the 
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device. 

25. A motion-based input system comprising: 

motion sensing means coupled to a device for sensing motion and 
providing a motion signal corresponding to the movement of the device; and 

processing means responsive to the motion signal and configured 

to: 

distinguish between tap commands and position commands 
and to provide, in response to the tap commands one or 
more actions and in response to the position commands one 
or more different actions to control and operate the device. 

26. A method for processing input commands for a device, the method 
comprising: 

detecting a motion signal conresponding to movement of the 

device; 

analyzing the motion signal to distinguish between a tap command 
and a position command; and 

providing, in response to a tap command, one or more actions and 
providing in response to a position command, one or more different action, to control and 
operate the device. 

27. A motion-based input system comprising: 

a motion sensor coupled to a device, the motion sensor providing a 
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motion signal corresponding to the movement of the device; and 

a first action or series of actions associated with a tap on the 



device; 



of the device; 



a second action or series of actions associated with other movement 

a processor responsive to the motion signal and configured to: 
distinguish between a tap on the device and other 
movement of the device; and to provide, in response to a 
tap, said first action or series of actions and in response to 
the other movement, said second action or series of actions 
to control and operate the device. 



BNSTOCID: <WO_02088853A1 J_> 



BNS page 26 



wo 02/088853 



PCT/US02/13181 



1/10 




FIG. IF 

PRIOR ART 

SUBSTITUTE SHEET (RULE 26) 



BNSOOCID: <WO__02088853A1J_> 



8NS page 27 



THIS PAGE BUNK (usHt) 



wo 02/088853 



PCTAJS02/13181 



2/10 




FIG. 2B 




FIG. 2D 

SUBSTITUTE SHEET (RULE 26) 



.020888S3A1 i > 



THIS PAGE BUNK m 



wo 02/088853 



PCT/US02/13181 





Ti^lS PAGE BUNK i^m 



wo 02/088853 



PCTAJS02/13181 



4/10 




SUBSTITUTE SHEET (RULE 26) 

BNSDCXJJD: <WO_02088853A1_L> P^9® ^ 



wo 02/088853 



PCTAJS02/13181 



5/10 




SUBSTITUTE SHEET (RULE 26) 



8NSDOC1D: <WO__02088853A1_L> 



HIS PAGE BUNK 



mm 



wo 02/088853 



PCT/US02/13181 




SUBSTITUTE SHEET (RULE 26) 

BNSDCXilD: <WO_02088853A1 J_> BNS page 32 



wo 02/088853 



PCT/US02/13181 



7/10 




FIG. 6 

SUBSTITUTE SHEET (RULE 26) 



BNSOOCID: <WO_02088853A1J_> 



BNS page 33 



wo 02/088853 PCT/US02/13181 



8/10 




a> 



SUBSTITUTE SHEET (RULE 26) 



BNSOOCID: <WO_02088853A1_L> 



BNS page 34 



wo 02/088853 



PCT/US02/13181 



9/10 




SUBSTITUTE SHEET (RULE 26) 



BNSDOaO: <WO_02088853A1_L> 



BNS page 35 



PAGE Bum 



wo 02/088853 



PCT/US02/13181 



10/10 



DETECTING A MOTION SIGNAL 
CORROSPONDING TO THE MOMENT ?.00 
OF THE ELECTRONIC DEVICE 



I 



ANALYZING THE MOTION SIGNAL 
TO DISTINGUISH BETWEEN A TAP 3^02 
COMMAND AND A POSITION COMMAND 



I 



PROVIDING IN RESPONCE TO A TAP 
COMMAND ONE OR MORE ACTIONS 
AND PROVIDING IN RESPONSE TO A ^f^ 
POSITION COMMAND ONE OR MORE 
DIFFERENT ACTIONS TO CONTROL 
AND OPERATE THE DEVICE 



FIG. 10 



J 



SUBSTITUTE SHEET (RULE 26) 



BNSOOCIO: <WO_020888S3A1J_> 



THIS PAGE BLANK (usfto) 



INTERNATIONAL SEARCH REPORT 



International application No. 
1*CT/US0«/13181 



A CLASSIFICATION OF SUBJECT MATTER 

1PG(7) : GOSB 19/18, 15/00; G09G 5/00» 5/08 

US CL :700/66. 85; 545/156.157.158 
Aooording to Intemational Patent CUssification (IPC) or to both national classification and IPC 


lib nKUl9 9£AKUU&1# 


Minunum documentation searched (dassilication system followed by dassification symbols) 
US. : 700/ ; 345/16.17,18 


Documentation searched other than nninimum documentation to the extent that such documents are included in the fields 

Ejl0 ft 


Electronic data base consulted during the intemational search (name of data base and, where practicable, search terms used) 
IEEE ONUNE. ACM ONUNE 


C DOCUMENTS CONSIDERED TO BE RELEVANT 


Category* 


Gtation ot document, with indication, where apj 


»ropriate, of the relevant passages 


Relevant to daim Na 


X 


US 3481.181 A (GLYNN, BJ.) 19 Januaiy 1993, see entire 
document, especially: colimm 1, lines 31-63; column 3, lines 44-56; 
column S, lines 41-68; column 9, lines 14-17; and column 11, lines 
18-25. 


1. 6-19. 23-27 


A 


US 5,694,340 A (KIM, C.H.) 02 December 1997, see entire 
document. 


1. 18. 21-27 


A 


US 5,874.942 A (WALKER, P.J.M.) 23 February 1999, see entire 
document. 


1. 18, 25-27 


A 


US 4.787,051 A (OLSON, L.T.) 22 November 1988, see entire 
document, especially: colunm 5, lines 10-23 and lines 50-68; column 
9, lines 21-42; and column 10, lines 4-20. 


1, 18, 25-27 


1 xj Further documents are listed in the continuation of Box C | \ See patent fanuly annex. 


* SpecUl categories of cited documents: 

"A* document defming the general sute of the art which u not 
considered to be of partic^ar relevance 

"E" earlier document published on or after the international filing date 

*L* document which may throw doubts on priority cUim(s) or which u 
dtcd to establish the publication date of another citation or other 
special reason (as spcolted) 

*0* document referring to an oral disclosure, use. eahibttion or other 
Rteans 

*P* document published prior to the international filing date but later 
than the priority date claimed 


*T* later document puUished after the international filing date or priority 
date and not in conflict with the ap|Uication but dted to uadcntand 
the ptinciple or theory undcriying the tnveotioa 

"X** document of particular rdcvanoe; the daimed inventiea caaaot be 
considered novd or caanoc be considered to involve an inventive step 
when the document ia taken alone 

"Y* document of particular idcvance; the claimed invention cannot be 
considered (o involve an inventive stq» when the document u 
combined with one or more other such documents, such combination 
being obvious to a person skilled in the ait 

"&* document member of the same patent family 


Date of the actual completion of the international search 
30 JUNE 800S 


Date of mailing of the intemational search report 

9i JUL 2m 


Name and mailinsr address of the ISA/US 
Commtsjioner of Patents and TrBdemarka 

Box per 

Washington. D.C SOSSl 
Facsimile N . (703) 305-3230 


Authorized officer [} l\ 1 

THOMAS BLACK " " 
Telephone No. (703) 305-9707 



Form PCT/ISA/ilO (second sheet) (July 1998)* 



BNSDOCio: <wo_0208a853Ai_i_> BNS page 37 





INTERNATIONAL SEARCH REPORT 


International application No. 
PCT/US02/13I81 . 






C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 


Category* 


Citation of document, with indication, where apprq>riate, of the relevant passages 


Relevant to daim N . 


A 
A 


US 6,188,392 Bl (O'CONNOR et al) 13 Febniaiy 2001, see entiie 
document. 

US 5,899,963 A (HUTCHINGS, LJ.) 04 May 1999, see entire 
document, especially: column 3, lines 14-31; column 5, lines 3-40; 
and column 8, line 56 through column 9, line29. 


1, 18, 25-27 
1, 18, 21-27 













Form PCT/ISA/210 (continuation of second sheet) (July 1998)* 



BNSDOCiD: <wo_02088853Ai j_> BNS page 38 



